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Abstract 

The objective of this work is to study weak infeasibility in second order cone programming. For this 
purpose, we consider a relaxation sequence of feasibility problems that mostly preserve the feasibility 
status of the original problem. This is used to show that for a given weakly infeasible problem at 
most m directions are needed to approach the cone, where m is the number of Lorentz cones. We also 
tackle a closely related question and show that given a bounded optimization problem satisfying Slater’s 
condition, we may transform it into another problem that has the same optimal value but it is ensured to 
attain it. From solutions to the new problem, we discuss how to obtain solution to the original problem 
which are arbitrarily close to optimality. Finally, we discuss how to obtain finite certihcate of weak 
infeasibility by combining our own techniques with facial reduction. The analysis is similar in spirit to 
previous work by the authors on SDPs, but a different approach is required to obtain tighter bounds. 
Keywords: weak infeasibility second order cone programming feasibility problem. 


1 Introduction 

Second order cone programming is an important class of conic linear programming with many applications 
[7]. The problem is solved efficiently with interior-point algorithms [131 [HI [H] as long as regularity conditions 
are satisfied. In this paper, we deal with the issue of weak infeasibility in second order cone programming 
(SOCP). Our starting point is the feasibility problem 

find X, such that x € K r\{L + c), [T) 

where c S M" and T is a linear subspace of M" and K is a closed convex cone. When AT is a product of 
Lorentz cones, this is the second order cone feasibility problem (SOCFP). {K, L, c) will be used as shorthand 
for the feasibility problem dZI- We say that (AT, L, c) is: (i) strongly feasible when (L -b c) 0 ri AT 0, where 
ri denotes the relative interior; [ii) weakly feasible, when A' n (L -|- c) 0 but (A -I- c) O ri AT = 0; {in) weakly 
infeasible, when A' 0 (A -|- c) = 0 but the distance between AT and A -|- c is 0; {iv) strongly infeasible, when 
AT n (A -b c) = 0 and the distance between A -b c and K is greater than 0. 

A major difficulty in identifying the feasibility status is the existence of weak infeasibility, since weak 
infeasibility does not admit an apparent finite certificate. A natural certificate of weak infeasibility is an 
infinite sequence mF) such that g A -b c and limfe_>oo dist(uF), AT) = 0, together with some certificate of 
the infeasibility of (AT, A, c). The sequence {uF)} is referred to as weakly infeasible sequence in this paper. 

*Department of Mathematical and Computing Sciences, Tokyo Institute of Technology, 2-12-1-W8-41 Ookayama, Meguro-ku, 
Tokyo 152-8552, Japan. (E-mail: flourenco.b.aa@m.titech.ac.jp) 

^Department of Computer Science, The University of Electro-Communications 1-5-1 Chofugaoka, Chofu-shi, Tokyo, 182-8585 
Japan. (E-mail: muramatu@cs.uec.ac.jp) 

^National Graduate Institute for Policy Studies 7-22-1 Roppongi, Minato-ku, Tokyo 106-8677, Japan. (E-mail: 
tsuchiya© grips .ac.jp) 

M. Muramatsu and T. Tsuchiya are supported in part with Grant-in-Aid for Scientific Research (B)24310112 and (C) 26330025. 
M. Muramatsu is also partially supported by the Grant-in-Aid for Scientific Research (B)26280005. T. Tsuchiya is also partially 
supported by the Grant-in-Aid for Scientific Research (B)15H02968. 


1 



Weak infeasibility of conic programs is mainly discussed in the context of duality theory of conic programs 
and regularization of ill-conditioned conic programs, e.g. [niiiiiisiiis]. In addition, it is closely related to 
the issue of closedness of image of closed convex cones, e.g., [HE]. See ID for a more detailed review about 
this issue. 

There is an alternative way to certificate weak infeasibility as follows. A weakly infeasible problem is 
characterized as one that is infeasible but not strongly infeasible. It is known that a system is strongly 
infeasible iff the system has a dual improving direction, see Table 1 in m- Therefore, checking infeasibility 
of the original system and checking nonexistence of a dual improving direction correspond to two conic 
feasibility problems, both of which can be solved with the facial reduction algorithm. In this way we can 
detect weak infeasibility without relying on an infinite sequence. However, this approach is not direct in the 
sense that even if we know that the system is weakly infeasible, it is not clear how to construct a weakly 
infeasible sequence. 

In this paper, we develop a procedure of detecting weak infeasibility which enable us to construct a 
weakly infeasible sequence. Specifically, we generate a set of at most m directions and show that we are able 
to construct a weakly infeasible sequence with these directions. A possible application of this result is to 
the analysis of SOCP with unattained optimal value. Knowing the optimal value, we are able to generate 
an approximate optimal solution whose objective value is arbitrarily close to the (unattained) optimal value 
without solving SOCPs repeatedly. 

We have three main contributions in this paper. First, we develop a way of constructing weakly infeasible 
sequence and show that for weakly infeasible problems over a product of m Lorentz cones, at most m 
directions are needed to approach the second order cone. We will describe in Section |T] the precise meaning 
of that, but we note already that this is tighter than a recent bound obtained by Liu and Pataki for general 
linear conic programs. Another new contribution is to show how strongly feasible optimization problems 
can be further regularized in order to ensure that the optimal value is attained. There is also discussion 
on how to obtain points that are arbitrarily close to optimality for the original SOCP. Finally, we discuss 
how to distinguish between the four different feasibility statuses, strong feasibility, weak feasibility, weak 
infeasibility and strong infeasibility without requiring any regularity condition. 

The main tool we use is the set of directions {d},... ,(P} contained in L which are obtained through the 
application of facial reduction to {K*, L^, 0) in order to obtain the relative interior of the feasible region of 
the dual system K* fl . In facial reduction theory, these directions correspond to a family of hyperplanes 
..., which contain K* n L^. As such, this gives an interpretation of these directions from 

the point of view of the dual problem. What is novel about our analysis is proving that these directions 
have other useful “primal” properties besides what is currently known through facial reduction theory. For 
instance, the relaxed problems induced by them have almost the same feasibility status as the original 
problem. For weakly infeasible problems, these directions are useful to generate points that are arbitrarily 
close to the cone. This can be applied to strongly feasible problems with unattained optimal value, thus 
enabling the algorithmic generation of feasible points that are close to optimality. Moreover, our sequence 
of directions is likely to be shorter than what would be otherwise obtained through plain facial reduction, 
since we show that is enough to focus on the nonlinear part of the cone. 

This work is organized as follows. Section El describes the notation and the setting of this work. Section 
El discusses how to relax a SOCFP in a way that the feasibility properties are mostly preserved. Section |4| 
discussed the minimal number of directions needed to approach the second order cone. Section [5| contains a 
discussion on unattained strongly feasible problems and how to regularize for attainment. SectionEjdescribes 
a theoretical recipe to distinguish the four feasibility statuses. Section [7| contains a brief summary of this 
work. 


2 Notation and preliminary considerations 

For d € K", we define the closed half-space = {a: € M" | (f"x > 0} and the ray h)) = {ad € K" | a > 0}. 
We also write x = (xq, ..., Xn-i) for the components of x. We use the notation x to denote the last (n — I) 
components of x, i.e., x = (xi,..., X(„_i)). The Lorentz cone in R” is denoted by /C", i.e., /C" = {x € 
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R" I where ||.|| is the usual Euclidean norm. We remark that /C^ = {a: G R | a: > 0}, so the 

non-negative orthant in R” can be written as a direct product of one-dimensional Lorentz cones. If a; G /C", 
we write x' for the reflection of x with respect to i.e., x' = (a;o, —x). 

Our main object of study is the feasibility problem da, where K is a direct product of Lorentz cones. 
We will also consider problems where K also includes closed half-spaces, rays and subspaces. We have 
K = X ... X /G”"*, where iG"* C R"‘ for every i and ni + rim = n. The cone K induces a block 
division such that for x G R" we have x € K ii and only if x^ G for every i. Throughout the article 
we use the convention that a superscript over a set indicates the dimension of ambient space. For example, 
are all sets contained in R". A single subscript under a point denotes a coordinate and double 
subscript denotes a block. For example Xi is the i-th coordinate of x, while Xm is the Tth block of x. Of 
course, it is implicitly understood that the division in blocks is induced by some cone K C R”. 

Finally, we use riC, recC, linC and relbdC to denote the relative interior, recession cone, lineality space 
and relative boundary of C, respectively. We denote the dual cone of K by K* = {s G R" | s'^x > 0, Vx G K}. 
See [T7] for basic properties of those sets. 

Two convex sets Ci, (72 C R" are said to be properly separated when there is a hyperplane such that C\ 
and C 2 lie at opposite closed half-spaces but at least one of them is not entirely contained in the hyperplane. 
A necessary and sufficient condition for proper separation is that ri(7i nri(72 = 0, see Theorem 11.3 of m- 
The separation is said to be strong if there is a ball B centered in the origin such that Ci + B and C 2 + B lie 
at opposite open half-spaces. A necessary and sufficient conditions for strong separation is dist((7i, C 2 ) > 0, 
see Theorem 11.6 of [Ill- 

Note that strong feasibility admits an obvious certificate, since it is enough to obtain an element x G 
ri ATn (L-|-c). From these basic facts about separating hyperplanes we can characterize two of the remaining 
feasibility statuses. We have that (AT, L, c) is: i) weakly feasible if and only if (iff) there is x & K r\{L + c) 
and w G {K* \ K^) n L-^ (7 where A-*- indicates the set of elements orthogonal to a set A, ii) strongly 
infeasible iff there is w G K* n with = —1. No such simple characterization is known for weak 
infeasibility, and this can be traced down to its asymptotic nature; in spite of the absence of a feasible 
solution, the distance between K and L -I- c is 0. Hence, there must be some sequence {x^} contained in 
L + c satisfying lim/f^oo dist(x^, AT) = 0. However, such a sequence cannot have any converging subsequence, 
so 11x^11 —>■ - 1 - 00 . 

Many of the known characterizations of weak infeasibility involve, in a way or another, infinite sequences 
(see Table 1 of Luo, Sturm and Zhang [IQ]). As a computer cannot verify infinite sequences, it is very hard to 
distinguish numerically between weak infeasibility and weak feasibility, see, for instance, Polik and Terlaky 
|16j . This motivates the search for ways of checking infeasibility without using sequences as in the recent 
work for semidefinite programming by Liu and Pataki [5], see Theorem 1 therein. See also Section 4.3 of 
[ 4 ] by Klep and Schweighofer. These characterizations are finite and no infinite sequences are needed. In 
Section m we will show that distinguishing weak feasibility/infeasibility for SOCFPs can also be performed 
without using sequences. 

For convenience, we group together weak feasibility and weak infeasibility in a single status: weak status. 
We say the feasibility status of feasibility problems A and B are “mostly the same” if A and B are both 
strongly feasible, strongly infeasible or in weak status. Note that it is possible that A is weakly infeasible 
and B is weakly feasible (or vice-versa). 

3 Relaxation of SOCFPs 

In this section, we show how SOCFPs can be relaxed in a way that the feasibility properties are mostly 
preserved. Consider a feasibility problem of the form (AT, L, c), where AT is a direct product A'"’^ x ... x A'"™, 
where each AT"* is: the trivial cone {0}; R"7 a second order cone a closed half-space defined by a 
supporting hyperplane to KA\ i.e., for d G /C"’ \ {0}; or a half-line contained in KAfi i.e., h()‘ for 
d€}C^\ 

Note that the family of cones having the format above is no more expressive than the family of products 
of second order cones. Still, for our purposes we need to consider this slightly more general situation because 
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these cones will appear as byproducts of Theorem [2] We will call them extended second order cones. We 
remark that the dual cone K* is the direct product of the duals of the cones and it is also an extended 
second order cone. It is also clear that we have = h^\ 

Suppose that we have a non-zero element a € K, then we define: i)'Hi{a,K) = {i \ € 

ri/C"*} and ii)% 2 {a,K) = {i \ S (relbd/C”*) \ {0}}. We will omit K when it is clear from 

the context. 

Lemma 1. Let x € M" and a € /C" be such that x’^a' > 0. Then x + ta € ri/C" for t > 0 sufficiently large. 

Proof. The point a must be non-zero and if it is an interior point, then the statement clearly holds. If a lies 
in the boundary, then 

{x + ta)Q — ||a; -I- ta|p = 2t{aoXo — a^x) + x^ — \\x\f. 

However, OqXq — if^x is equal to x’^a'. So if t is large enough we have that {x + ta)Q — \\x + tap will be 
greater than 0. □ 

Theorem 2. Let {K,L,c) be a feasibility problem such that K = x ... x if"”*. Suppose that there is 
a £ K r\L such that 7ii(a) U'H 2 {a) is non-empty. Define the cone K = if"i x ... x if"”* such that for every 
i: 

• =IR"* ifi£ni{a), 

• if"* = Hf' where d = a'^., if i £ 7 ^ 2 ( 0 ), 

• if"* = if"*, otherwise. 

Then 

i. (K, L, c) is strongly feasible if and only if {K, L, c) is strongly feasible; 
ii. {K,L,c) is in weak status if and only if {K,L,c) is in weak status; 
in. {K,L,c) is strongly infeasible if and only if {K,L,c) is strongly infeasible. 

Proof, (i) If {K, L, c) is strongly feasible, then for a relative interior point y £ L c, we have > 0, for 

all i £ TL 2 {a). All the other coordinate blocks of ym stay in the relative interior of the respective cones. So, 
(if, L, c) is strongly feasible. 

Now, if (if, L, c) is strongly feasible we pick y £ L -\- c such that y lies in the relative interior of if. For 
i £ Til (a) we have Om £ ri/C"* and for i £ TL 2 {a) we have yni^-'m > 0- Hence if t is sufficiently large we have 
(y -I- ta)f.a'.^. £ int(/C"*), for all i £ iii(a) U ii 2 (a), by Lemma [TJ It is also clear that adding ta does not 
affect the fact that £ ri(if"*) for i ^ iii(a) U ii 2 (a). 

{in) If {K,L,c) is strongly infeasible then {K^L^c) also is because K C K. Let us prove the converse 
now. We have that (if, L, c) is strongly infeasible if and only if there exists s such that s £ L-^ n if* and 
s^c < 0 (see Lemma 5 of [11]). In particular, s'^a = 0. This means that s'^mm = 0 for every i, because 
s £ if* and a S if nL. It follows that for i £ 'Hi{a) we have s„. = 0. Also, for i £ 7 ^ 2 ( 0 ) we have that s„. is 
a non-negative multiple of a'„. (including, of course, the possibility that is 0)0. We conclude that s also 
produces strong separation for {K, L, c) because s £ if*. So (if, L, c) is strongly infeasible. 

Finally, {ii) follows by elimination. 

□ 

^Recall that if x,y £ satisfy x^y = 0, then xoy + yQX = 0. 
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3.1 Relaxation sequence 

After applying Theorem [5] to {K,L,c), it might still be possible to relax it further. This motivates the next 
definition. 

Definition 3 (Relaxation sequence). A relaxation sequence for (K,L,c) is a finite sequence of conic feasi¬ 
bility problems {(Hi, L,c),..., {Kj, L, c)} such that Ki = K and: 

1. Every Ki is an extended second order cone, see the beginning of Section\^ 

2. Fori > 1, there is € Ki-iCiL such that (Ki,L,c) is obtained as a result of applying Theorem\^to 
Ki-i n L and d^~^. In addition, we must have Ki-i C Ki (i.e., we do not admit trivial relaxations). 

The vectors in {d^,... ,dA~^) are called reducing directions, due to the fact that they came from the appli¬ 
cation of facial reduction to the dual system {K*, L-^,0). A relaxation sequence is maximal if it does not 
admit non-trivial relaxations. The problem (Kj,L,c) is called the last problem of the sequence. The length 
of the sequence is defined to be j. 

We now attempt to clarify the connection between relaxation sequences and facial reduction. Given a 
conic linear program (K, L,c), facial reduction algorithms (FRAs) [TJ[3JUnjHO] aim at identifying the minimal 
face J{nin of K which contains the feasible region Kn{L-\-c). This is done by generating a sequence of faces 
ending at In this respect, FRA and relaxation sequences accomplish different goals. However, it can 

be shown that the cones appearing in a relaxation sequence correspond to the dual of the faces obtained 
by applying FRA to {K*,L^,0). As we are considering dual of faces instead of the faces themselves, this 
is more akin to the conic expansion algorithm as described in Section 4 of [5D]. While this allows us to 
cast our techniques in the conic expansion framework, as it is a more indirect route, it seems that not much 
geometric insight is gained by doing that. Moreover, it is not obvious that results such as Proposition [7] 
and Theorem hold. In the next two sections, we will use relaxation sequences to prove basic properties of 
weakly infeasible problems and unattained problems. 

Since every reducing direction is responsible for relaxing at least one Lorentz cone, the maximum length 
of a relaxation sequence is m +1, where m is the number of second order cones appearing in K. Each relaxed 
problem almost preserves the feasibility status of the original, in the sense of Theorem [T] We will prove 
that when the relaxation sequence is maximal, the last problem cannot be weakly infeasible. Before we go 
further, we need a detour which we believe might be of independent interest. 

Theorem 4. Let C\ and C 2 be non-empty convex sets in R" such that Ci is polyhedral, C 2 is closed. Suppose 
that 

recCi n —recC '2 C linC' 2 , 

where recC = {x G R" | x + C C C} is the recession cone of a closed convex set C. Then Ci + C 2 is closed. 

Proof. See Theorem 20.3 in [T7]. □ 

We will show that if C 2 is the direct product of a closed convex set and a polyhedral set, we may weaken 
the assumptions of the Theorem |4l 

Proposition 5. Let Ci and C 2 x P &e non-empty convex sets in R" such that Ci and P are polyhedral, and 
C 2 is closed. Suppose that 

recCi n — (recC '2 X recP) C linC '2 x —recP (I) 

Then Ci + (C 2 x P) is closed. 

Proof. We have that Ci + C 2 x P = (Ci + {0} x P) + C 2 x {0}. Since Ci and P are polyhedral sets, 
(Cl + ({0} X P)) is also polyhedral. We would like to use Theorem S] with (Ci + {0} x P) and C 2 x {0}. For 
that purpose, we are required to check that 

(recCi + ({0} X recP)) fl —(recC 2 x {0}) C linC 2 x {0}, (2) 
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because, due to polyhedrality, rec (Ci + ({0} x P)) = recCi + ({0} x recP). Let {x, y) be a point that belongs 
to the set at the left-hand side of Equation ([2|), then x G —TecC 2 and y = a + p = 0, where p G recP and 
{x,a) G rec Cl. It follows that (a;, a) G —(recC 2 x recP). Since we are under the assumption that Equation 
HI) holds, X G linC 2 . Hence, {x,y) G linC 2 x {0} and we are done. □ 

The following proposition is a small modification of Corollary 20.3.1 of m 

Proposition 6. Let Ci and C 2 x P 6e non-empty convex sets in R" such that C\ and P are polyhedral, and 
C 2 is closed. Suppose that 

rec Cl n (recC 2 x recP) C linC 2 x recP. (3) 

and that Ci H (C 2 x P) = 0. Then Ci and C 2 x P can be strongly separated. 

Proof. Since Ci fl (C 2 x P) = 0, we have that 0 ^ Ci — (C 2 x P). Applying Proposition[5]to Ci and — (C 2 x P) 
we find that Ci — (C 2 x P) is closed. Therefore, both sets can be strongly separated. □ 

Proposition 7. If {(ATi, P, c),..., {K-y, L, c)} is a maximal relaxation sequence for [K, L, c) then we have: 

i. (K,L,c) is strongly feasible if and only if {Kj, L,c) is strongly feasible; 

ii. {K, L, c) is in weak status if and only if {K-y, L, c) is weakly feasible; 

Hi. {K,L,c) is strongly infeasible if and only if {Kj, L,c) is strongly infeasible. 

Proof. By induction and using Theorem [21 items (z) and {Hi) follow. We can also conclude that {K,L,c) is 
in weak status if and only if {K^, L, c) is in weak status. Now, suppose that {Kj, L, c) is infeasible and that 
{K, L, c) is in weak status. To hnish the proof, we have to show that {K-y, L, c) cannot be weakly infeasible. 

Reordering if necessary, we may assume that Kj = K x P, where K is the direct product of Lorentz 
cones and P is a polyhedral cone. In this case, P is a direct product of half-spaces and vector spaces. Now, 
we would like to use Proposition [5] by setting Ci = P -I- c, C 2 = AT and P = P. Let us check that Equation 
dni) is satisfied. We have recCi n (recC 2 x recP) = P fl (AT x P) and linC 2 x recP = {0} x P. 

Pick an element x G L D (AT x P). We must have x G {0} x P, otherwise we would be able to apply 
Proposition [2] one more time, which would contradict the assumption of maximality. Since Equation ([3|) is 
satisfied, it follows that if {K-y,L,c) is infeasible, it must be strongly infeasible. 

□ 

Example 8. Let (AT, P, c) be such that K = K? x K? and L-\-c= {{t,t,s) x (s, s, 1) | {t, t, s) G IC^, (s, s, 1) € 
/C^}. Then, a = (1,1,0) x (0,0,0) G K r\ L. Thus, we can relax the cone constraint from K? x to 
H^, X . Now, b = (0,0,1) X (1,1,0) G H% x K?. Thus, we can relax the problem from H^, x K? to 

Til '^1 

X Hi, . The problem {Hi x Hi , P, c) is weakly feasible, because no point in L c strictly satisfies 

ni ^?^2 Til ^^2 

the inequalities which define x H?, . This implies that (K^L^c) is in weak status. 

ni n2 

4 The minimal number of directions needed to approach K 

Let K be an extended second order cone, therefore it is a direct product of Lorentz cones and polyhedral 
cones. Suppose that there are m Lorentz cones among them. In this section, we will show that given a 
weakly infeasible feasibility problem (AT, P,c) there is c' G K”, a subspace L' contained in P of dimension at 
most m such that {K,L',c') is weakly infeasible. This means that starting at c', at most m directions are 
needed to approach the cone. One application of this result is on the study of problems with unattained 
optimal value, as in Section [5] Note that, a priori, the number of direction needed to approach the cone 
could be up to the dimension of the affine space P -I- c. Theorem [5] states, however, it is bounded by m, 
regardless of the dimension of P -|- c. 
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Theorem 9. Let {K,L,c) be a weakly infeasible problem. Then there are a subspace L' Q L and c' € L + c 
such that {K,L',c') is weakly infeasible and dimension of L' + c' is at most m, where m is the number of 
Lorentz cones. 

Proof. Let c),..., (iL^, L, c)} be a maximal relaxation sequence and {d^,..., the associated 

set of reducing directions. Each d* is responsible for relaxing at least one Lorentz cone. Since there are most 
m of them, there are at most m directions. Due to Proposition [3 the last problem is weakly feasible, so it 
admits a feasible solution c'. 

If L' is the space spanned by {d^,..., d'>'“^} then {K,L',c') is weakly infeasible. After all, {K,L',P) 
shares the same maximal relaxation sequence and Proposition [3 implies that {K,L',c') has weak status. 
Also, L' + c' is an affine subspace of L + c, so (AT, L', c') is an infeasible problem. □ 

Let 5" denote the cone of n x n positive semidefinite matrices. In [5], it was shown that given a weakly 
infeasible semidefinite feasibility problem (SDFP) (iS",L,c), there is an affine space L' + c' contained in 
L + c of dimension at most n — 1 such that (<S", L' ,c') is weakly infeasible. Transforming a weakly infeasible 
SOCFP into a n X n dimensional SDFP, immediately yields the bound n — 1. Note that this a much worse 
bound since n — 1 is typically larger than the number of Lorentz cones m. 

Recently, Liu and Pataki generalized the results in [5] and showed that the dimension of L' + c' can 
be taken to be less or equal than ix* — 1, see items ii. and Hi. of Theorem 9 in [B]. The quantity ix* 
corresponds to the length of the longest chain of faces of K*. A chain of faces of AT is a hnite sequence of 
faces satisfying Ai C ... C and the length is defined to be ^. For the SDP case, they showed that the 
bound can be refined to £ 5 ^ — 2, which matches the bound discussed in [5], since ^s^ = n + I. 

If A' = X ... X /C"™, then the largest chain of faces of K* has length 2m + 1. Liu and Pataki’s result 
implies the bound 2m on the dimension of L' + c', which is too pessimistic in view of Theorem [3 


5 Finding the optimal value in a strongly feasible unattained prob¬ 
lem 

Consider a pair of primal and dual SOCPs problems: 


inf 

X 

T 

C X 

(P) 

subject to 

Ax = b, X G AT* 


sup 

b^y 

(D) 

y 



subject to 

c — A^y G AT, 



where A : K." —>■ R™ is linear map, b € R'”, c G R" and is the adjoint of A. We will denote hy 6p 
and 6d, the primal and dual optimal values, respectively. Now, suppose that one of them (but not both) 
satisfy Slater’s condition. This assumption can be satished by applying facial reduction to ®, for instance. 
Under these conditions, if the objective function of m is bounded above, then 9p = Op and the primal 
optimal value is attained. However, the dual optimal value may not be attained. It is natural then to 
consider whether © and © can be regularized so that the common optimal value is attained at both 
sides. Moreover, one may be interested in finding dual feasible points for © which are arbitrarily close 
to optimality. In this section, we will show how to use the techniques developed so far to accomplish both 
tasks. 

The first step is to consider the subspace L = (range fl {A'^y \ {b, y) = 0}. Let a = —AA'y^ G A fl AT 
be a nonzero point and let AT be cone obtained as a result of applying Theorem [2] to (AT, A,c). We have the 
following lemma. 

Lemma 10. Suppose that © is strongly feasible, i.e., there is y such that c — A^y G riA'. Let 9p = 
sup{6^y I c — G AT}. Then 9p = 9p. 
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Proof. As K D K, we have Ojo < Od- We will now show that 6d > (^d holds as well. The first observation is 
that Theorem [2] ensures that (7^,rangec) is strongly feasible as well. This, together with the definition 
of implies that for every ^ < 9d, there is such that = c — € riK and {b, y^) > ji. 

Because is a relative interior point of K, if ai is positive and sufficiently large, it will be the case 
that + aia^ € riK, by Lemma[TJ As + aia^ = c — + aiy^) and {b,y^) = 0, we conclude that 

JZ/i + c(iy^ is a feasible solution for (|D]) whose value is at least y. This readily shows that = 9o. 

□ 

Under the conditions of Lemma[Tni it is possible that the optimal value of the relaxed problem is attained 
even if 9u is not attained for ©■ We will now show that if former is attained, then it is possible to construct 
solutions close to optimality for the latter in a natural way. The recipe is as follows. Suppose that y* is an 
optimal solution for sup{(&, y) \ c — A^y € K} and let y be any point such that c — A^y € riK. For every 
/3 G [0,1), the point sp = c — A'^{{1 — Ay + fiy*) lies in the relative interior of K. Following the proof of 
Lemma ITOl for fixed /3, there will be some A such that sp + a\a^ G K. Note that sp + aia^ corresponds to 
a feasible solution having value (6, (1 — Av + As /? goes to 1, sp + aia^ approaches optimality, at the 

cost of, perhaps, making A large. The next step is to show that if we keep relaxing the problem, we will 
must eventually reach some problem whose optimal value is attained if 0 _d is finite. 

Theorem 11. Suppose that (IdI) is strongly feasible. Let L = (range fl {A'^y \ b^y = 0} and consider a 
maximal relaxation sequence for (K,LyC). Let K.y be the cone eorresponding to the last subproblem. Consider 
the following SOCP in dual format. 

sup b'^y (D’) 

y 

subject to c — A^y G K.y, 


The following properties hold. 

i. © has a relative interior feasible solution, so the corresponding primal problem (P’) is attained. 

ii. The optimal value 9o' of (ID’j) satisfies 9 di = 9d. Lf9o' is finite, then it is attained. 

Proof. Successive applications of Theorem [2] yield the first item. Using Lemma [10] and induction, we can 
also conclude that 9d' = 9d. We now suppose that 9d' is finite and assume, for the sake of contradiction, 
that the optimal value is not attained for (ID’I) . 

We first observe that the affine space J" = (c + range fl {{AAy \ b'^y = 9 d'} is non-empty. Also, the 
Euclidean distance between A and K~f must be zero. Both observations follow from the definition of 9d', 
which ensures the existence of a sequence {y^} contained in (c-l-range PIwhich satisfies b'^y^ —>■ 

Having observed that, we will proceed as in the proof of item ii of Proposition [T] Since there is no 
optimal solution for m, we have P fl K.y = 0. Reordering the coordinates if necessary, we can write K.y as 
the direct product of a closed convex cone K and a polyhedral cone P. Note that the recession cone of T is 
L and the recession cone of K.y is Kj. By the maximality of the relaxation sequence, the nonzero part of any 
point in the intersection L n must be contained in the polyhedral portion P. Therefore, Equation ([3|) is 
satisfied and Proposition [6] ensures that P and can be strongly separated. Thus the Euclidean distance 
between these two sets must be positive, which is a contradiction. 

□ 

We can now extend the recipe discussed after Lemma 1101 Let {a^,..., aP'j the corresponding reducing 
directions which produces the cone K.y. Pick an optimal solution y* for (ID’ll and let y be any solution such 
that c — A^y G ri A'.y. By induction, for a fixed /3 G [0,1) there are positive constants ai,..., such that 
zp = c — A^((l — Ay + Py*) + corresponds to a feasible solution to ([D| having value equal to 

6^((1 — Ait + Py*)- As before, when j3 approaches 1, the value of zp approaches 9^. This shows very clearly 
how the reducing directions can be used to construct a path towards optimality. Moreover, the discussion 


on Section |4] shows that at most m directions are needed to build points close to optimality, where m is the 
number of Lorentz cones. 

To wrap up this section, we remark that we proved similar results for SDP in Section 5 of [9], where it 
is shown how to obtain a pair of primal and problems such that both are strongly feasible. Therefore, a key 
difference here is that Theorem m does not ensure that (P’) has a relative interior point. However, this is 
not necessary to ensure attainment, due to Proposition [6] and the fact that we have a mixture of nonlinear 
and polyhedral cones. 

6 Determining the Feasibility Status 

Let (if, T,c) be an arbitrary SOCFP. According to Theorem [2] the feasibility status of (AT, L,c) and the last 
problem {Kj,L,c) is exactly the same, except, perhaps, if {K,L,c) is weakly infeasible. As mentioned in 
Section [21 there are simple (finite) certificates for three of the feasibility statuses and these are exactly the 
three statuses that are possible for {Kj, L, c). 

Therefore, to determine the feasibility status of {K,L,c), one can first compute a relaxation sequence 
of {K,L,c) and seek for appropriate certificates for {Kj,L,c). If {Kj,L,c) is weakly feasible then we have 
ahead of ourselves the task of distinguishing between weak feasibility and weak infeasibility of (AT, A, c). To 
do that, it is enough to produce a finite certificate of infeasibility for (K, L, c), which can be done through 
facial reduction [HIKISIIID] as follows. 

The variant in [20] is capable of detecting infeasibility. Starting with Fg = AT, facial reduction algorithms 
(FRAs) successively identify elements d* € {F*_-^ \ n satisfying (d*,c) < 0. After d* is found, we 
define Fi = Ai_i n {d*}-** and repeat. At any step, if no d® exists, then the minimal face of AT which contains 
the feasible region is precisely Ai-i. As the Fi form a strictly descending chain of faces of K, dimensional 
considerations readily imply that FRA must end in a finite number of steps. Moreover, it can be shown that 
(AT, A,c) is infeasible if and only if (d®,c) < 0 at some iteration. For more details, see Section 3 in [20]. If 
K is an extended second order cone, it is possible to show that the search for d® can be cast as a SOCP as 
well. The upshot is that we may do facial reduction without ever leaving the SOCP world and the vectors 
d® serve as witnesses of the infeasibility of (AT, A,c). 

The certificate coming from facial reduction, the set of reducing directions associated to a relaxation 
sequence and a feasible solution to the last problem neatly summarize all aspects of weak infeasibility. Note 
that Theorem |2| and its proof show that the directions and a feasible solution to the last problem can be 
used to construct points in A + c which are arbitrarily close to AT. This fulfills the goal of producing a finite 
certificate that dist(A', A + c) = 0 in spite of the fact that dC n (A + c) = 0. 

Example 12. Let {K,L,c) be as in Example\^ The last problem obtained was {H^, x FI?, ,L,c), which 

ni n2 

was a weakly feasible problem. IFe now have to find out whether (AT, A, c) is weakly infeasible or feasible. In 
this ease, it is easy because the point (s,s, 1) can never belong to K?. If the problem were more complicated, 
one could formally do facial reduction and check its infeasibility. Note that, following Theorem\^the vectors 
a, b and (0, 0,1) x (0,0,1) attest that dist{K? x /C^, A + c) = 0. 


7 Conclusion 

In this paper, we presented an analysis of weakly infeasible problems via relaxation sequences. We used that 
to prove a basic result on the existence of affine subspaces that preserve the weak infeasibility of the problem 
(Theorem 12]) and we showed how to regularize a strongly feasible problem in order to guarantee that it is 
attained. 
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